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Abstract i In this paper , we present a quantitative analysis of the robustness of a reduced-order 
pole- assignment state-space self-tuning controller for a multivariable adaptive control system wbcee or- 
der of the real process Is higher than that of the model used In the controller design. The result of sta- 
bility analysis shows that, under a specific bounded modelling error, the adaptively controlled closed- 
loop real system via the reduced-order state-space self-tuner is BIBO stable in the presence of unmod- 
elled dynamics. 
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1 Introduction 

The problem of robustness of an adaptive control system has recently been studied by many 
authorsC 1 *^. This is because the development of adaptive controllers for adaptive control systems 
is based on the assumption that the model used in the controller design is an accurate representa- 
tion of the real process > however, the degree of most real processes is often higher than that of 
the model used in practice. As a result , a stability problem may occur due to a mismatch of the 
orders of the modeled processes and the real processes^. Hence, a study of robust stability of the 
utilized algorithms for the controller design is necessary. 

During the last decade , vast amount of research was devoted to quantitative analysts of the 
robustness of self-adaptive algorithms such as the development of conic sector theory and normal- 
ized system schemeO* s 3. In reference [4], the normalized parameter estimation approach com- 
bined with a dead-zone method in which the modelling errors are treated as a bounded disturbance 
and utilized as a parameter adaptation stopping criterion to guarantee global stability was devel- 
oped. In contrast, in reference [5], the robust stability of a multivariable adaptive controller 
based on a factorization approach was established, which is useful for the robust stability analysis 
of adaptive algorithms. 

In this paper, we are concerned with the robust stability of the multivariable adaptive con- 
trol system via the reduced-order state-space self-tuning controller developed In reference £6]. 
Our approach to quantitative analysis of the robust stability of the adaptive control system^ can 
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be described as follows. First , we utilize the normalized parameter estimation scheme^ to carry 
out the parameter estimation with the presence of unmodelled dynamics. Then, we use the ana- 
lytical method developed in reference [5] to resolve the robust stability of the adaptive control 
system via the reduced-order state-space seif-tunerW. Finally, we determine the bound of the 
modelling error with which the self-tuner can be tolerated. 

2 System Description 

In this paper, both of the plant and the reduced-order model are assumed controllable and 
observable. 

Consider the following m- input- output block observer- type discrete- time stochastic linear 
plant. 


* 0 •<*) = a;z;(m - l ) 4 l) + *;«*(*- n, (la) 

y(i) = <VV(*> + e*(t) ( lb ) 

where 
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and f(*)6R* are input and output vectors, respectively! block elements A*, 
R" x *(»=l,2,»*,r) are constant matrices, i. , (t)GR , (»=l,2,*«,r) «*(*)(rR* is the inno- 
vation process which is a white noise process with zero mean and covariance R* £R" X * and 

sup II* •(*)!! <<*. (2) 

o<*<» ' 

with K ! 6R* rX * is the Kalman gain matrix. 


A* (z wl ) = /. + 4* + ••• 4- A or z~' y ( 3 a) 

B* (z~ l ) * B. x z~' + 4- ... + B^z~*, ( 3 b ) 

D*(z -1 ) = /■ 4- D.\z~ x 4* 4 ••• 4- .(3c) 

and D* ** A* 4- Km* *— 1,2, •••,»*. (3d) 


It is observed from (3d) that the Kalman gain K m can be directly computed from the estimated 
parameters D m and A* An alternate representation of the original system in (1) can be described 
as follows, 


,(*) «*•*#•(*) 4 - «•(*), (4a ) 

where 


6 mT — [Ai,*** (4 b ) 

<P*(i) — [— yi(i — l),*»i — y«(i — 1),*», — jp N (l — r),a,(i — 1),»*. , 

u.(* — 1), •••»«.(* “ r),e, # (i — I), — ,<«•(* — 1),‘ ••,«;(* — r)] T , (4c) 
The d m in (4) is the parameter matrix of the original system. For a reduce -order controller de- 
sign, a reduced-order observable model is required as 

«.(*) = Aa(* - 1) 4- BM * - 1) + KMl - 1), 


(5a) 



No. 3 Robustness of Reduced-Order Multivarlablo State-Spaco Self-Tuning Controller 279 


Jftt) - <?*.(*) + «(*), 
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(7a) 

(7b) 


where a^r, and «(i) is the innovation process of the model. 

The equivalent observable ARMAX model of (5) is 

» B(a- l )u(i) + 0(r* l )«(i), 

The alternate form of the model in (6) can also be rewritten as follows. 

y(i) =^(i) +e(i), 

where 

,B mt Z),i, ••*,/)«], 

^(*) ** [— 7i(* *“ 1) »**• i — jr«(i — 1) ,*♦* , — jr.(t — a) ,ui(i — 1),«. , 

“«(* ~ 1) » i««(i ~ a),ej *(* - 1 ),•••,«; (t — 1) , ••• »ej (t - a)] T . (7c) 
where $ is the parameter matrix of the reduced-order model. The e(i) in (6) can be decomposed 
into two terms, 

«(*) = «(*) + «*(*)» (8a) 

where e* (t) is the innovation process of the original system and 

«(*) = (i) __ 0T0 (i) # (gb) 

In reference £6] , it was assumed that e(i) in (8) isa zero-mean stochastic sequence and statisti- 
cally independent of e* (i). In this paper, the assumption in reference [6] is relaxed so that e(i) 
is not a zero-mean stochastic sequence and can be represented as 

D(z-')Hi) = Ad T A0(l ) , (9a) 

where 

__ i C^on-H t *•* * A, B M +) , ••*#«., , **• » T > ft, 

= \o, 


r — a, 


(9b) 


j<P(i) = [— yi (l - a - 1),— , - ?.(* - a - 1), — , - y.(i - r), ai (t - a - I),.*., 

««(* — a — l),»*,a«(i — r) ,e{ (t — a — 1) »*•• ,e^ (i — a — 1), — ,e;(* — r)] T . 

(9c) 

Then* from (9a), it is reasonable to make the following assumption: 

Assumption 1 Assume that there exists a /r>0, such that for 0, the unmodelled error 
satisfies the constraint: 

II «(*) II ^ M II d<P(i) | , (10a) 

and further, we have 

H *C*) If II *•(»>! , OOb) 

where $•(*) is related to the plant input end output sequences. Eq. (10b) shows that the mod- 
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“ „ rebtlvelir bounded i therefore. * *» * considered . measure of the relative 

ZZZ ZL - — — - “ 1 ' ^ 0, ' U " 

modelUns error with which the adaptive controller can be tolerated. 

T Normalized Parameter Estimation 

to order to deveiop an adaptive control law . we shaU firs, introduce the p^anreter estimate 

algoritiun for the model in <». »»)-»(»)-•. *e estimated output »«)-»<* 

Defining the parameter estimation error, 9K 

and the innovation process, «(*) “»<*>-$(*>• 

The reduced-order mode! equation to be estimated Is written as follows, ^ 

>W =$r<t-l )*(»)+•(«. (Ub) 

#(» - 1 ) - -J * 

Mt) = c- »><‘ - n '"‘’ " ,m(t ~ ~ '■ 1 (l _ ,)]T. (lie) 

„ (I _ l),...,e.(t 1). •".«.<*- °> ,t - ( ' ,J 

, . .t . bounded disturbances , the 

As far as the parameter identification is concerned , in the case o 

:=z:z t^E 

- "ir: zzzzz * — - — — 

zzzzz. . — - — — * - ,o — the ^ 

eter A.. Rt. and Da to («• 

The normalized variables of the process are defined as 


yd) 


zed variaoies 01 

*(t) (1 2b) 

a(t) = max( max 1<P* (*) I * r *) * 

. a*, u. ^ i-th element of 0 # . Using these nor- 
where r. is a pre-selected positive constant . and A - *• * 

malized variahies, the model to (7.) can be rewritten as Mows, (m) 

y«(fc) SS tf'tP’Ck) + d'(fc) , 


where 


na) + «•(*>] 
*<» = 1 — • 


(13b) 


-rr 1 *rr=:^ r“,> . 

bounded. 

Proof * 

„ ... iL + < /QO - *>"0 H + 1T» (13C) 

11 <K*> li < + •(*> 

we are able to estimate an upper bound of 


Define 
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4 “ [4i»"*i4.] T i 

where 4<>0 is an estimate of an upper bound of |j}(4) |, i®» 1, •••*«. Also, define 3*=» 
| 4 | , then 3* Is an estimate of an upper bound of | d*(4) | . 

Based on the identification algorithm in [4], we can obtain the convergence properties of 
the posterior estimation error and of the parameters. A posterior estimation error is defined as 

«<4) A *(*> ~ $*(*)<&(*). (14) 

Lemma 2 According to the esimation algorithm in [4], we have, 

i) || 0(4) || is uniformly bounded, which implies that there exists a constant Af>0, and 

00 1)60=* {$» II 0 II , where O is a closed subset of R 1- * 

ii) lim[ || 0(1) || l — II 0(4—1) || l ]«0| 

*— "X> 

iii) lim[ || 0(4) || — || 0(4— A) j| ] = 0, A is a limited positive integer » 

h »oo 

iv) There exists a positive integer A', such that 

II e(i) II < 2J*max || <P* (4) || ,r.), as 4 > K„ 

This proof can be found in reference [4]. 

4 Multivariable State-Space Self-Tuning Controller 

Once the system parameters 0(4) are obtained, the adaptive control law can be determined 
as follows^ , 

The estimated 2.(4) with 0(4) can be written as 

2.(4) - A(4)2.(4 - 1) + §,(4)ti(4 - 1) + £.(4)1(4 - 1) , (15a) 

y(4) = CT2,(4) -M(4), (15b) 

where .3.(4), £,(4) and £,(4) are the 4th step estimation of 4> B, and A., respectively. 

Assumption 2 Let (?(0) sa! [^; - '^.ii4;‘'*B*» ,, *,A^.,^.3. Assume that there exists a posi- 
tive real constant y,>0 such that |det(7(0) |^y,. Then, the state-feedback control law is given 
by 

«(4) = /f.r(4)-/7TA(4), (16a) 

where r(4)£R" is a reference input vector with an input gain matrix AT.£R" X “, /7£R* X *“ 

Fm ** <*m — 4*» **=!,*••*» ( 1 66) 

where 4. comes from the controllable model of (15), and 

• • 

a,W = = TT (U - ~ P '>' (16c) 

i- 0 «-i 

det(A/ M - 4 - ^T.)] = JJdet(A7. - />,). (16d) 

5 Extended Dynamic System Description 

In this section , we reformulate the adaptive control system developed in previous sections in- 
to a composite dynamic system which is suitable for robust stability analysis using the theory de- 
veloped in the next section. 

First, let 


^(4) = [d>* T (4) ,ij(4)3» 


(17) 
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where 0* T (t) and £(*) are defined in <4c) and (15), respectively. Next, we rewrite 

#•<*) i 

$•(1 + 1) “ $<!>•(*) + $,(*) + «.(*) + *••(*). (18a) 


where 


5 = 


0 0 0 

/.<,-» 0 0 


I.Cr- 


;fr— !} « 

• e 

: : 

0 0 

JL 


(18b) 


(18c) 

(18d) 

(18e) 


0 r (t ) = [_ f T (i),o?,-,o?,oj,-,o?,o , « T ,— .ocr3i 

= [o?,-,oj,tt T (i),o?,«*,o , j,o?,-,o; T ], 

<£.(*) - [«?.-" , 0? , Off , , 0'J,e * T (D , Off, , Off] , 

where 0?=[0,- ,0] lx .. Then, from (15b) and (16a), Eq. (18a) becomes 

<f>*(i + 1) =* S4>* (2) + 0j(t)i*(l) + 02 (t)«(t) + 0j(l)a*(l) 4* 04 (*)r(t) » (18a) 

where 
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'-CT 


- 1: 
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- FYT t 
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. 0 . 


.0. 


. 0 . 


(19b) 


(20a) 

(20b) 


Substituting (16a) into (15a) gives 

2.(1 -f 1) = (^(*) ~ 8.(i)/7T.)2.(*) + A'.(t)Ki) + S.d)^(i) 

= F x (.k)z,(k ) + £.(*)«(*) + 6,(*)ff.K*)» 

F,(i) = A,(t) - iU*)/7r„ 

and combining the resulting equations (19a) and (20a) yields the composite dynamic equation of 
the closed-loop system : 

Z(i + o * ^(fc)Z(i) + 02(t)?(i) + 0j(i)«*(t) + iJKi)r(i) (21a) 

where 

fS 0j(4)”l P:(*)] _ ... _ P»(*>1 „ T D *(*) 1 

E>w “ [0 f,<»J ’ El ” U.(t)J ’ ,( > “ L 0 J ’ *‘ ( ) • 

(21b) 

In the following section, we carry out the robust stability analysis using (21a). 

6 The Robustness of Sell-Tuning Adaptive Controller 

In this section, we state two lemmas as follows. 

Lemma 3 Consider the time-varying difference equation 

x(f + 1) * v4(f)*(0 -h /(«,*), *«i) -*j€ 


(22a) 
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where /(<,*) is bounded as 

8 /(*.*) fi < (*• + *»<«» B x <‘> I + r * (0 » 

<o>0, 0<^»CO 6 and 0<r,(O € I". 

Suppose that the zero- Input system in (22) of the form 

x(t + 1) - iKO*«> 


(22b) 


(23) 


is exponentially stable, i.e. , there exist some constants «i>l and l>a x >0 such that 

1 4>«,<i) II < aioi'-V (24) 

for any h>0 and <><„ where 0<Mi) b *e state transiUon matrix of the system in (23). 
Then , if the following inequality is satisfied * 


0<io< 


(1 - a : ) 

' “ » 

*1 


(25) 


we can conclude that 

i) *C06«“. nnd in addition, » *«> 11 <»«) as «-<». where *(0 is the output of the 
system with the transfer function (7C*- , )=« l /<*-<*a“t+<*», driven <V '»«>• 

ii) Whenever r,(Oei’. md »€[ then which impli “ ® l(<) I' "*° “ ‘ 

-*■00. 

Proof see reference £53* 

Le mma 4^ Consider the system 

xO + 1) - A(0x(0 ( 26 > 

which has the following properties* 

a) 8 AG) 8 Is uniformly bounded * 

b) There exist 0<«o<C 1 1 such that 

max|AjCKO)l <1 “ «o< 1 ,or ^ 

c) sup || i4«*f l)-*-4(0 8 is sufficiently small. 

where 4, is a positive constant, and A, 04(0) denotes the jth eigenvalue of the matrix AG). 
Then, the system is exponentially stable. 

In order to show the system in (21a) to be exponentially stable, we proceed throu|h the fol- 
lowing steps. 

Step 1 Show that BiW satisfies part a) of Lemma 4. 

From t 2-0, we know that || Ad) II and || fed) || are bounded. From Assume 

don 2, we know that | ft II and [ T, || are also bounded. Thus, R fed) II & bounded. 

Step 2 Show that £»(*) satisfies part b) of Lemma 4. 

Since 

det (A/ - £,(*)) =det(A7 - 5)det(A/ - F X G)) 

m 

=det(A/ - 5) ]Jdet(A/« - P<) (27) 

the roots of det(A/ — 5) are zero. If we choose P if i- 1, ••• ,<n such that det(M-fe) has no 
roots lying outside the circular disk, i.e. , 0<U|<l-«. and 0<«.<1, then fed) satisfies 
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part b) of Lemma 4. 

Step 3 Show that £,(*) satisfies prat c) of Lemma 4. 

The above fact can obviously be verified from Lemma 2-iii) and Assumption 2. 

Based on the results shown in the above three steps, we coclude that E^k) is exponentially 

stable. This implies that an association of the and a* with the exponentially stable Z?,(t) is evi- 
dent. 

Next, we explore the norm bounded property of the forcing terms, Eye(.k) t Eye' (i), and 
in (21a) as follows. 

By virtue of Lemma 2-0 , Assumption 2, Lemma 2-iv), and (2), we have 
II £*(*) + Eye'(k) + E ir (k) || 

|| i(i) || + A, || «* (*) II + A*, || r(k) || 

<2A' t J*[ || <P* (k) j| -f r,] -f KzS, -f A s |J r(i) || , (28a) 

where A ’i=J>up^ || E z (k) || , A' 2 =^up^ || A,(t) || . = || £ 4 (i) || . From (13c), we 

know that / 0 (r-«)m]*+ 4 /r.is an upper bound of || j-(t) || , and 4 is an estimate of an up- 
per bound of J| J-(i) || . Thus, if we can choose 4<//[3(r~a)m]H+4/ r# for the estimation 
in reference [4], then 


l|£jl(*> + + e,.(t) II <2tf,0[3O - .)»]* + £][ II <5- (t) || +r j 

+ KA + A’i || r(l) || (28b) 

<2*.l>[3<r - .)m]« + f][ || z(t) || + 

+ AV. + A*j || r(k) || . 

Now, comparing (22b) with (28b) yields 

*■ 


= 2A’i[u[3(r — n)inj^ + 


4i(*) — 0, r 2 (k) - 2A*,[//[3(r - *)m? -4- — -f Ky6, -f A'j || r(k) || . 

r * 1 

Then, applying Lemma 3. we have the following main results for the adaptive controller. 

Theorem 1 With Assumptions 1 and 2, if the M in (10a) (a measure of the relative mag- 
nitude of the modelling error) is bounded as 


0 < u < * R ~~ _ 2 A' x <5.1 

2AiL3(r - «)«]* L o, * 

nc the J 4 in the estimation algorithm^ 3 satisfies 


(29) 


0 < 4 < ^[3(r - *),/,]* + it, (30) 

then the adaptively controlled close-loop system via the reduced-order controller is BIBO stable for 
any initial condition in both the plant and the adaptive controller irrespective of the presence of 
unmodeiled dynamics. 

RemcrV 1 The BIBO stable system has the following properties , 
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0 Z(t)er, then y(i)6r, and u(t>e^i 

U) U Z<*) II <v(*)» M *~*’ <x> * where v(*) is the output of the system with the transfer 
function 

<*\ 


- x - <CA + a,)’ 


driven by 
iii) 


|| zw II <»'(*> + [ _ ( „°J t + - , j (2A ' Ar - + AA) - <31) 

where t/(t) is the output of the system with the transfer function driven by 

Ki II r(k) H • ^ 

Kama* 2 The va.ux <» <»> * Jf 

the robustness of the adaptive controller. It implies that the adaptive controller is allowed to be 
perturbed by the modelling error 2(0 satisfying the ? in (29). For the pole-assignment algorithm 
in this paper once we have selected the desired closed-loop polynomial matrix c-,(A) in < 16c) , it 
is possible to determine a, and Oj a priori. As a result, we have the knowledge of the degree of 
robust stability for the controller to be designed. 

7 Conclusions 

This paper has demonstrated that the state-feedback pole-assignment self-tuning controller^ 
has a certain stability robustness. As a result , the reduced-order model can be used to design a re- 
duced-order self- tuner with suitable conditions and the adaptively controlled closed- loop original 
system via the designed reduced-order self-tuner is BIBO stable in the presence of unmodelied dy- 
namics. 
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